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ABSTRACT 

The Patient-Centered Outcomes Research Institute 
(PCORI) has launched PCORnet, a major initiative to 
support an effective, sustainable national research 
infrastructure that will advance the use of electronic 
health data in comparative effectiveness research (CER) 
and other types of research. In December 2013, PCORI's 
board of governors funded 1 1 clinical data research 
networks (CDRNs) and 18 patient-powered research 
networks (PPRNs) for a period of 18 months. CDRNs are 
based on the electronic health records and other 
electronic sources of very large populations receiving 
healthcare within integrated or networked delivery 
systems. PPRNs are built primarily by communities of 
motivated patients, forming partnerships with 
researchers. These patients intend to participate in 
clinical research, by generating questions, sharing data, 
volunteering for interventional trials, and interpreting 
and disseminating results. Rapidly building a new 
national resource to facilitate a large-scale, patient- 
centered CER is associated with a number of technical, 
regulatory, and organizational challenges, which are 
described here. 



LAUNCHING PCORNET, A NATIONAL CLINICAL 
RESEARCH NETWORK 

The potential of comparative effectiveness research 
(CER) for dealing with practical clinical questions, 
enhancing the quality and effectiveness of care, and 
personalizing evidence-based care, is clear. 1 Yet 
CER strains the current clinical research paradigm 
because of its emphasis on assessing effectiveness in 
typical care delivery settings, its requirement for 
very large study populations to study effectiveness 
heterogeneity, and, often, its need for treatments to 
be allocated by randomization. 

In July 2012, the Patient-Centered Outcomes 
Research Institute (PCORI) convened a national 
multi-stakeholder workshop to advance the use of 
electronic health data in CER. 2 Building on research 
networks that include among others, the HMO 
Research Network, the Agency for Healthcare 
Research and Quality (AHRQ) American Recovery 
and Reinvestment Act (ARRA) investments in data 
networks, the US Centers for Disease Prevention 
and Control (CDC) Vaccine Safety Data Link, the 
Food and Drug Administration's (FDA) Mini- 
Sentinel, the National Institutes of Health (NIH) 
Health Care Systems Research Collaborator^ two 
components of a national research infrastructure 
emerged. 3-8 These comprise clinical data research 
networks (CDRNs) based on the electronic health 
records and other electronic sources of very large 
populations receiving healthcare within integrated 



or networked delivery systems 9 and patient-powered 
research networks (PPRNs) built by communities of 
motivated patients, forming partnerships with 
researchers. 10 CDRN and PPRN brief communica- 
tions included in this special focus issue provide 
further information about these networks. 

In December 2013, PCORI's board of governors 
funded 11 CDRNs and 18 PPRNs for a period of 
18 months starting in March 2014 that together 
form PCORnet (http://www.pcornet.org). Each 
CDRN is committed to building a large patient 
cohort with comprehensive, longitudinal electronic 
clinical data; developing policies for data standard- 
ization, shared governance, efficient use of clinical 
information for multicenter studies, stringent atten- 
tion to data security and patient privacy, and 
robust, scalable centralized research support tools; 
and building the capacity to participate successfully 
in multi-network randomized trials and observa- 
tional studies. Each CDRN is a collaboration of 
health systems that include among others academic 
health centers, community hospitals, health plans, 
inpatient and outpatient hospitals and providers, 
federally qualified health centers, veterans' adminis- 
tration clinics, pediatric hospitals and providers, 
integrated delivery systems, private electronic 
health record companies, and a regional health 
information exchange (table 1). 

Each PPRN consists of patients, caregivers, or 
families, who are linked by the experience of a 
shared condition (table 2). An important commit- 
ment of these patient-based networks is to collect 
and curate data from at least 80% of their member- 
ship. The PPRNs are also expected to expand the 
number of patients in their network; to collect 
standardized patient data; and, when necessary, for 
the purposes of research, engage patients to partici- 
pate in interventional research and in building, 
using, and governing their networks. The organiza- 
tional set-up of PPRNs is diverse, as exemplified by 
the number of different partnership models that 
link patient foundations and associations with aca- 
demic research centers. The CDRNs and PPRNs 
are geographically diverse, with patients in 50 
states (figure 1). 

A coordinating center co-led by the Harvard 
Pilgrim Health Care Institute and Duke University 
(contract awarded in September 2013) provides 
technical and logistical expertise and assistance to 
awardees. It has established 11 task forces (figure 2), 
whose members are nominated from the CDRNs 
and PPRNs and whose role is to develop policies, 
operations, and products to support the develop- 
ment of PCORnet. A steering committee, subject to 
the oversight of PCORI, guides members of 
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Table 1 Clinical data research networks 



Clinical Data Research Network (CDRN) name 



Lead organization 



Accelerating Data Value Across a National Community Health Center Network (ADVANCE) 
Chicago Area Patient Centered Outcomes Research Network (CAPriCORN) 
Great Plains Collaborative 

Kaiser Permanente and Strategic Partners Patient Outcomes Research to Advance Learning (PORTAL) 
Louisiana CDRN 
Mid-South CDRN 

A National Pediatric Learning Health System (PEDSNet) 

New York City clinical data research networks (NYC-CDRN) 

Patient-oriented SCAIable National Network for Effectiveness Research (pSCANNER) 

A P2aTH Towards a Learning Health System in the Mid-Atlantic Region (P2aTH) 

Scalable Collaborative Infrastructure for a Learning Healthcare System (SCILHS) 



Oregon Community Health Information Network 

The Chicago Community Trust 

University of Kansas Medical Center 

Kaiser Foundation Research Institute 

Louisiana Public Health Institute 

Vanderbilt University 

The Children's Hospital of Philadelphia 

Weill Medical College of Cornell University 

University of California, San Diego 

University of Pittsburgh 

Harvard University 



PCORnet and advises PCORI leadership (figure 2). Final 
approval of all policies, activities, and recommendations resides 
with the PCORI leadership. 

PCORNET DISTRIBUTED DATA RESEARCH NETWORK 

PCORnet is being developed as a distributed research network 
(DRN) that facilitates multi-site, observational and interven- 
tional research across the CDRNs, PPRNs, and other interested 
contributors, while minimizing the transfer of individual-level 
clinical data outside of the system where care is received. 
PCORnet's unique vision is to create a network that supports 
the CDRN and PPRN internal network development while cre- 
ating a mechanism to facilitate research across these networks. 
Advantages of conducting research across multiple networks of 



PCORnet comprise greater sample size and power, the ability to 
study effects of practice pattern and treatment variation, the 
inclusion of diverse populations, and the possibility of support- 
ing analyses that assess heterogeneity of treatment effect. 

The distributed network will enable research studies to be 
conducted, while allowing each participating organization to 
maintain physical and operational control over their data. This 
structure lowers institutional barriers to participation and 
ensures availability of local experts who can interpret the 
data. 11 12 The Data Standards, Security and Network 
Infrastructure (DSSNI) task force will identify minimal data 
standards and technical specifications for data standardization 
across CDRNs and PPRNs and develop an approach to cross- 
network querying that meets the security, patient privacy, 



Table 2 Patient powered research networks 



Patient-Powered Research Network (PPRN) name 



Condition 



Adrenoleukodystrophy (ALD) Connect 

American BRCA Outcomes and Utilization of Testing PPRN (ABOUT 
Network) 

ARthritis patient Partnership With comparative Effectiveness 
Researchers (AR-PoWER PPRN) 

Chronic Obstructive Pulmonary Disease (COPD) Patient Powered 
Research Network 

Collaborative Patient-Centered Rare Epilepsy Network (REN) 
Community-Engaged Network for All (CENA) 



Crohn's and Colitis Foundation of America (CCFA) Partners PPRN 



ALD 

Hereditary breast and ovarian cancer 

Arthritis (rheumatoid arthritis, spondylarthritis), musculoskeletal disorders (osteoporosis), and 

inflammatory conditions (psoriasis) 

COPD 

Aicardi syndrome, Lennox-Gastaut syndrome, Phelan-McDermid syndrome, hypothalamic 
hamartoma, Dravet syndrome, and tuberous sclerosis 

Alstrom syndrome, dyskeratosis congenita, Gaucher disease, hepatitis, inflammatory breast cancer, 
Joubert syndrome, Klinefelter syndrome and associated conditions, metachromatic leukodystrophy, 
Pseudoxanthoma elasticum (PXE), psoriasis 
Inflammatory bowel disease (Crohn's disease and ulcerative colitis) 



Duchenne Connect Patient-Report Registry Infrastructure Project 
Health eheart alliance: a PPRN focused on cardiovascular health 
ImproveCareNow: a learning health system for children with Crohn's 
disease and ulcerative colitis 
Mood PPRN 

A multiple sclerosis PPRN 

NephCure Kidney Network for patients with nephrotic syndrome 

The Patients, Advocates and Rheumatology Teams Network for 
Research and Service (PARTNERS) Consortium 
Phelan-McDermid Syndrome Data Network 
Primary Immunodeficiency Patient Research Connection (Pi-Connect) 
Sleep Apnea-Patient Centered Outcomes Network (SA-PCON) 
The Vasculitis Patient Powered Research Network 



Duchenne and Becker muscular dystrophy 
Cardiovascular health 

Pediatric Crohn's disease and ulcerative colitis 

Major depressive disorder and bipolar disorder 
Multiple sclerosis 

Primary nephrotic syndrome (focal segmental glomerulosclerosis, minimal change disease, and 
membranous nephropathy) 
Juvenile rheumatic disease 

Phelan-McDermid syndrome 
Primary immunodeficiency diseases 
Sleep apnea 
Vasculitis 
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institutional confidentiality, and governance needs of the 
network participants. 13 

The distributed querying approach allows simple and 
complex analyses to be executed behind institutional firewalls, 
thereby eliminating or minimizing the release of protected 
health information. Instead, only the minimum information 
needed to answer a specific question is transferred to the person 
making a request. Increasingly, even complex multi-site analyses 
can be accomplished without transfer of private health informa- 
tion by use of privacy preserving regression techniques. 14 15 



As part of their PCORnet participation, each CDRN will 
develop an analyzable research dataset (to be specified by the 
DSSNI task force) that supports complex distributed analyses. 
After 18 months, this dataset should contain data on one 
million patients and the CDRN will be able to regularly com- 
plete queries against the dataset using the secure PCORnet 
DRN tools. An example of the type of observational studies that 
might be supported by the DRN is a comparison of the out- 
comes of ischemic and hemorrhagic stroke in adults with atrial 
fibrillation who are new users of dabigatran or warfarin. 16 The 




Figure 2 Organizational structure of 
PCORnet. AHRQ, Agency for 
Healthcare Research and Quality; 
ASPE, Assistant Secretary for Planning 
and Evaluation; CDC, US Centers for 
Disease Prevention and Control; CMS, 
Centers for Medicare and Medicaid 
Services; FDA, Food and Drug 
Administration; NIH, National Institutes 
of Health; ONC, Office of the National 
Coordinator for Health Information 
Technology; PCORI, Patient-Centered 
Outcomes Research Institute. 




PCORnet STEERING COMMITTEE 

Members represent: 
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PCORnet DRN tools will be developed by input from the rele- 
vant task forces, including DSSNI, Governance, and Data 
Privacy during the first 18 -month phase of funding (starting 
March 2014). The DSSNI task force will develop a PCORnet 
common data model (CDM) to support the development of 
analyzable research datasets that will permit efficient distributed 
analyses. The PPRNs aim in 18 months to have the ability to 
build a standardized clinical database with relevant clinical and 
patient-reported outcomes data from at least 80% of their mem- 
bership. Overall, implementation of the PCORnet DRN net- 
working and querying capabilities will prioritize rapid 
development, testing, use, and feedback learning cycles. This 
process will enable experimentation in networking approaches, 
demonstrate approaches to secure network operations, and iden- 
tify potential barriers as early as possible. 

PCORNET AND PATIENT-CENTEREDNESS 

Over the 18 -month funding phase, each CDRN and PPRN will 
develop effective patient-engagement strategies at the level of 
their networks. These strategies will involve ensuring that 
patients have a central role in collecting data for the generation 
of new knowledge for patients with their condition, as well as 
in participating in the governance of the network, prioritizing 
research questions, and disseminating results. 10 At the CDRN 
level, patient engagement strategies require developing 
approaches to inform patients who are members of the systems 
of the existence and function of the research network, to 
involve patients in generating research questions, and in includ- 
ing patients in the governance associated with the development 
and uses of the network. 9 

CHALLENGES 

Rapidly building a new national resource to facilitate large-scale, 
patient-centered CER will face a number of technical, regula- 
tory, and organizational challenges. 

Technical challenges, first, include successfully completing the 
capture of relevant longitudinal clinical data, a requirement for 
all CER studies. Since most electronic health record systems typ- 
ically do not have information on care provided outside their 
health system, both CDRNs and PPRNs will need to explore 
approaches to dealing with this problem. 17 Second, in order to 
achieve multi-institutional querying, PCORnet will have to deal 
with data harmonization. 18 This will require understanding the 
context in which the data were collected, the various clinical 
and other terminologies in use, and changes in local systems 
and national standards (such as those associated with the 
Centers for Medicare and Medicaid's 'meaningful use' regula- 
tion) that affect the data. This should be done without requiring 
a change in the way the routine medical care data are collected, 
and will require data harmonization. 19 20 PCORnet has chosen 
to develop a CDM, derived from the Mini-Sentinel CDM to 
enable efficient cross-networking querying. 21 Third, the collec- 
tion, harmonization, and use of a wide range of potential 
patient-reported data (eg, personal and family medical histories, 
use of remote monitoring devices, etc) for research is a nascent 
field, 22 yet promises to empower patients to provide data that 
more fully describe their experience of, and preferences for, the 
treatment and management of their condition. In the absence of 
a standardized ontology or lexicon for a large number of these 
data elements, the ability to routinely include this information 
in analyzable research datasets will be explored in this first 
phase of PCORnet's development but will probably occur fully 
in later phases. 



In addition to technical challenges, PCORnet will need to 
examine ethical and regulatory oversight. Many patients, advo- 
cates, and researchers describe the research oversight system as 
cumbersome, inefficient, and expensive. 23-25 PCORnet will 
need to deal with problems associated with the design of appro- 
priate clinical studies, informing prospective participants, and 
obtaining permissions in a manner that protects human rights 
while supporting the acknowledged need for more research to 
provide patients and clinical decision-makers with more reliable 
evidence. 26 Areas of interest that PCORnet will explore through 
its task forces include central institutional review boards or 
internet-facilitated shared review systems, and, centralized 
support for enrolling subjects and obtaining their consent. 
Because of the scale and complexity of the types of research 
envisaged, PCORnet will be challenged to develop streamlined 
approaches to the structure and function of the network and its 
projects while maintaining sound ethics and regulatory 
compliance. 

PCORnet will be faced with the organizational challenges 
associated with the rapid development of a national resource 
with a heterogeneous group of CDRNs and PPRNs of varying 
size, populations served, health systems included and many 
other characteristics. Although this diversity among awardees 
was both predictable and desirable, one area in which the diver- 
sity of networks was quickly apparent was the divergent 
approaches used for data management. Nevertheless, each 
CDRN and PPRN will be challenged with balancing the 
demands of their local networks, research cultures, and areas of 
particular expertise with the requirements of participating in a 
national research resource. This will require them to agree 
rapidly on a common approach to data interoperability and to 
the conduct of joint analyses. 

PCORnet's success and long-term sustainability will also 
depend on communicating with health system leaders and pro- 
viding them with evidence of the benefits of conducting high- 
quality, efficient research as part of the routine delivery of care. 
Securing the commitment of delivery systems' leaders, health 
system administrators, and clinicians will require considerable 
strategy and effort by all PCORnet stakeholders. Finally, and 
importantly, PCORnet is committed to supporting patient 
engagement across the networks and will need to deal with the 
challenges of successfully supporting a variety of governance 
structures that fully ensure that patients are involved in setting 
policies for PCORnet and for their own networks, determining 
strategic direction, and prioritizing research questions. 27 

PCORNET WILL BE OPEN TO EXTERNAL DATA PARTNERS, 
RESEARCHERS, AND FUNDERS 

The PCORnet DRN will be open to external data and research 
affiliates willing to participate in research studies alongside the 
PCORI-funded CDRNs and PPRNs. Of particular note, 
PCORnet's distributed networking platform is shared by the 
FDA Mini-Sentinel program, the NIH Health Care Systems 
Research Collaboratory and other networks such as the HMO 
Research Network. 3 6 7 Any organization that is part of these 
networks can make itself visible to the others and choose to 
receive queries from any of them. PCORI's vision is for the 
PCORnet DRN to be available for use by researchers not dir- 
ectly affiliated with PCORnet CDRNs and PPRNs through col- 
laborative arrangements. The proposed governance models and 
mechanisms for these types of collaboration will be developed 
during the initial 18 -month funding phase, which started in 
March 2014. 
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CONCLUSION 

The first phase of building PCORnet will span 18 months. At the 
end of this time, we hope that a functional research network that 
can support both observational and interventional research will 
have emerged. We also expect a new model for efficiency and 
affordability in clinical research, made possible both by investments 
in, and use of, this evolving data infrastructure, and the involve- 
ment of host healthcare systems, clinicians, and patients together 
with researchers. Although PCORnet will need to continue to 
grow and improve its data resources and capabilities, a measure of 
success will be the willingness of external research funders, both 
public and private, to fund research studies using PCORnet. 
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